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ABSTRACT 

Presented at the annual meeting of the National 
Association for Research in Science Teaching (NARST) in April, 1972, 
in Chicago, this study compared the achievement and retention of 
ninth grade ohysical science classes receiving instruction with a 
prior knowledge of behavioral objectives with ninth grade classes 
taught the same material without prior knowledge of the objectives. 
The resultant data indicated that classes with a prior knowledge of 
the obiectives did achieve significantly higher on the achievement 
test an^ retention test employed. (Author/CP) 
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INTRODUCTION 

During the last decade the schools of our nation have 
investigated new classroom materials and different methods 
of instruction in their attempt to increase learning effect- 
iveness. Of the numerous methods of instruction that have 
been proposed, one which is currently being investigated by 
science educators is that of the behavioral approach to 
learning. 

Advocates of behavioral objectives for education such 
as Walbesser (1970), Mager (1962), and Popham (1969) have 
called for curriculum development using measurable objec- 
tives written in behavioral form. 

The literature is replete with articles concerning the 
utilization of behavioral objectives. However, the reported 
classroom research on the effectiveness of using behavioral 
objectives in instruction is far from complete. 

This investigator believed, therefore, that research 
needed to be accomplished with classes to ascertain the rela- 
tive value of the behavioral objective approach to learning. 

Statement of the Problem 

The problem of this study was to compare the cchievement 
and retention of ninth grade physical science classes receiv- 
ing instruction with a prior knowledge of behavioral objectives 
with ninth grade classes taught the same material without prior 
knowledge of the objectives. 
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This investigation was conducted to answer the following 
questions: 

1. Does prior knowledge of the behavioral objectives 
for a given unit in the physical sciences alter 
class performance on an achievement test? 

2, Does prior knowledge of the behavioral objectives 
for a given unit in the physical sciences alter 
class performance on a retention test? 

Statement of the Research hypotheses 

1. The mean scores of classes studying IME Science 
( Interaction of Matter and Energy) # as measured by the Achieve 
ment Test, will be higher for those classes provided with 
behavioral objectives prior to Instruction than for those 
classes not provided with the objectives. 

2. The mean scores of classes studying IME Science, as 
measured by a Retention Test, will be higher for those classes 
provided with behavioral objectives prior to instruction than 
for those classes not provided with the objectives. 

Subjects 

Fourteen ninth grade physical science classes from the 
two junior high schools of the Ridgewood Public School System 
participated in the study. A total of 306 students completed 
the experiment. Ridgewood, New Jersey > is a suburban residen- 
tial community of approximately 30,000 inhabit»»‘ ts located 
in the Northwest portion of Bergen County, twenty-one miles 
from New York City. 
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Experimental Design 

This experiment was designed to assess the effects of 
behavioral objectives on class achievement and retention. 

The experimental classes received instruction in physical 
science witri stated behavioral objectives and the control 
classes received physical science instruction without know- 
ledge of the objectives. 

Eighteen behavioral objectives and thirty-six assessment 
tasks were constructed by the investigator and evaluated by 
ten science educators. Nine action verbs were used. They 
were : apply the rule , construct, distinguish , demonstrate , 

describe , identify , order , predict and stvate ^ rule. (Wal- 
besser, 1966). The behavioral objectives are included as 
Appendix A. 

The subject matter studied in this experiment dealt 
with energy transfer, phases of matter, heat energy and light 
energy as found in chapters ten, eleven, twelve and thirteen 
of the science program IME (Interaction of Matter and Energy ). 
(Abraham, etal, 1969). The subject matter content used with 
both experimental and control groups was the same; however, 
stated behavioral objectives with assessment tasks were used 
in the experimental classes. The variable measures in this 
experiment v.ere the mean scores obtained by the classes on 
the loll owing instruments. 

Instruments Used to Measure the Variables 

The STEP (Sequential Test of Educational Progress ) was 
used to measure the entering performance level of all subjects 
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prior to the start of the experimental study. The test is 
designed to measure a wide range of understanding and skills 
related to performance in science. The STEP test in sciences 
Form 3-A, Series II, is a fifty-item, multiple choice test 
with a reported reliability coefficient of 0.89, and a stan- 
dard error of 2.9 (Educational Testing Service, 1970, P9» 30). 

The IME ( Interaction of Matter and Energy ) quarterly 
and final achievement tests were designed by Rand McNally & 
Company. Each of the IME quarterly and final achievement 
tests are fifty-item, multiple choice examinations reporting 
reliability coefficients (Kuder Richardson Formula 21) 

Ranging from 0.832-0.867 (IME - Interaction Newsletter, 

Number 5, 1969, pg. 7). 

Statistical Design 

The research design considered appropriate for this 
study was Campbell and Stanley's (1966) control group design 
number ten in which the intact groups constitute naturally 
assembled classes. V.ith subjects in pre-assembled classes 
it was necessary to randomly assign the treatments to the 
intact classes. To control any differences in student 
ability in the two groups of classes, experimental and control, 
the analysis of covariance was used to statistically control 
any differences. The classroom mean score was used as the 



unit of analysis. 
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ASSIGNMENT OBSERVATION TREATMENT OBSERVATION OBSERVATIOjj 



0, 4 T > 0« 3> O 3 

0. ^ no T ^ O 2 ^ O 9 

ic "X 

E = Experimental classes received treatment 

of Behavioral Objectives. 

C = Control classes did not receive the 

Behavioral Objectives, 

R = Random assignment of treatment to intact 

groups. 

Oj = STEP Test used as Pretest. 

Og ® Achievement Test. 

O 3 = Retention Test. 

The formal testing began at Ridgewood Schools in .ianu- 
ary, 1971. At this time the Otis-Lennon Mental Ability Test, 
Form J,was administered to all ninth grade students by the 
guidance department. 

The STEP - Sequential Test of Educational Progress ; 

Form 3 A , was administered to all IME classes to measure the 
entering performance level in science of all subjects in the 
sample prior to the start of the experiment. Two weeks 
following the administration of the STEP Test, the instruct 
tional program began in all classes. 
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The behavioral objectives for each chapter were given 
to the experimental classes, one chapter at a time. Follow- 
ing this initial overview of the chapter's objectives, 
assessment task sheets were provided, one objective at a 
time, to insure a more complete exposure and reinforcement 
for each of the behavioral objectives. 

At the conclusion of the three month instructional 
period, the IME third unit Achievement Test was administered 
to all 14 class sections. The achievement test papers were 
machine scored and the scores placed on punched cards for 
computer analysis. Fourteen sets of data were analyzed using 
the following computer programs: (1) ANOVA-Analysis of 

Variance, developed at thb University of California - BMD-OIV 
and BMD-OID, (2) ANCOVA- Analysis of Covariance with homogene- 
ity of regression test, developed by Dr. C. Mitchell Dayton 
at the University of Maryland, and (3) MANOVA-Multi variate 
Analysis of Variance, developed at the Biometric Laboratory, 
University of Miami. 

The analysis of covariance tested the effect of treatment 
on achievement and retention for the experimental and control 
classes. This analysis is particularly useful since it is 
the blending of regression and the analysis of variance which 
permits statistical rather than experimental control of the 
variables. 

After three weeks, the Retention Test was administered 
to all 14 classes to compare the experimental and control 
groups in terms of the amount of "forgetting". The retention 
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scores were also submitted to the computer for statistical 
analysis. 

Findings 

Four measures were obtained on each subject in the 
experimental and control classes. The mean scores for the 
experimental and control classes are illustrated in Tables 
one and two. 
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TABIE 1 

MEAN SCORES AND STANDARD DEVIATION * 
EOR THE EXPERIMENTAL GROUPS OH THE 
FOUR MEASURES 



GROUP 


N 


S0?EP 


IQ 


1 


21 


78.09 

(10.22) 


110.04 

(9.06) 


2 


21 


75.61 

(14.2A) 


113.33 

(11.64) 


5 


18 


76.11 

(14.75) 


112.55 

(18.04) 


4 


26 


73.38 

(13.29) 


108.57 

(11.63) 


5 


21 


76.33 

(11.76) 


113.95 

(12.26) 


6 


25 


77.91 

(13.21) 


116.13 

(12.51) 


7 


27 


78.95 

(11.79' 


115.48 

(12.63) 


8 


23 


84.60 

(7.82) 


117.86 

(13.17) 



ACHIEVEMENT RETENTION 



65.61 

(10.65) 


61.14 

(10.66) 


68.28 

(9.96) 


67.80 

(9.75) 


66.33 

(16.69) 


66.44 

(15.22) 


65.15 

(12.97) 


65.07 

(10.94) 


65.23 

(14.60) 


64.95 
( 12. 19 ) 


70.26 

(14.48) 


70.08 

(13.90) 


70.37 

(10.92) 


67.48 

(11.44) 


73.82 

(12.08) 


68.86 

(12.58) 



* > Standard Deviation Scores In Parentheses. 
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MEAM SCORES AND STANDARD DEVIATION* 
FOR THE CONTROL GROUPS ON THE 
FOUR MEASURES 



GROUP 


N 


STEP 


IQ 


ACHIEVEMENT 


RETENTION 


1 


22 


75.63 

(15.5^) 


112.68 

(15.59) 


62.27 

(15.65) 


55.01 

(19.18) 


2 


22 


76.00 

(12.46) 


116.54 

(12.61) 


61.00 

(9.88) 


54.11 

(15.89) 


5 


25 


75.56 

(15.29) 


113.04 

(15.5^) 


55.92 

(16.75) 


51.68 

(15.55) 


4 


16 


76.75 

(15.73) 


115.06 

(12.56) 


58.37 

(10.63) 


53.00 

'14.12) 


5 


17 


82.47 

(9.73) 


118.58 

(11.90) 


63.41 

(10.43) 


62.58 

(14.41) 


6 


24 


82.83 

(9.02) 


119.45 

(8.16) 


66.08 

Ul.55) 


60.85 

(13.08) 



♦ - Standard Deviation Scores in Parentheses* 
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Results 

The experimental r/oup obtained higher mean scores than 

the control group on both achievement and retention tests. 

The overall mean differences were found to be statistically 

signigicant at the .01 level of confidence using the Fisher 

F Test with the analysis of covariance. In regard to the 

hypotheses tested, the following is reported: 

HYPOTHESIS 1. H^ : Pc • 

® ^ach. ‘'ach. 

There is no significant difference in achievement as 
measured by the IME Achievement Test three, between the Ex- 
perimental ninth grade classes provided with the behavioral 
objectives prior to instruction and the ninth grade Control 
classes not provided with the objectives. 

To test this hypothesis, the analysis of covariance 
technique was used since adjustments for pre-test differences 
between the experimental and control groups on the dependent 
variable can be statistically controlled. The covariates 
were the IQ and STEP scores. 

Assumption of homogeneity of regression was tested and 
accepted before proceeding with analysis of covariance. 
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TABLE 3 

ANALYSIS OF COVARIANCE 
OF THE ACHIEVEMENT SCORES 
FOR ALL CLASSES 



SOURCE 


OF 


SS*1 


MS 


F 


P 


Treatment 


1 


197.860 


197.860 


37.784 


<.001 


Regression 


2 


106.565 


53.283 


10.175 


<.004 


Within 


10 


52.366 


5.237 






1 - SS* indicates Sums of Squares on adjusted criteria 


scores 



The data presented in Table 3 show the analysis of 
covariance on the achievement scores. The adjusted mean 
scores for experimental and control groups were 68.13 and 
60.84 respectively. The difference between these two 
values was statistically significant beyond the 0.01 level. 



HYPOTHESIS 2. 



H. 






U/ 



‘ret ret. 

There Is no significant difference in retention as 



measured by the Final Test (selected test items appropriate 
to the third unit material) between the experimental ninth 
grade classes provided with behavioral objectives prior to 
instruction and the ninth grade control classes not provided 
with objectives. 
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The Investigator felt* as with hypothesis 1, that analy- 
sis of covariance should be used to test hypothesis 2 since 
any difference In experimental groups could be statistically 
controlled by using the IQ and STEP scores as covariates. 
Assumption of homogeneity of regression was tested and 
accepted. 

The data presented in Table 4 show the analysis of 
covariance on the retention scores. When the effects of IQ 
and STEP Test were removed by covariance, the adjusted mean 
scores for experimental and control groups were 66.48 and 
56.19 respectively. The difference between these two values 
was statistically significant beyond the 0.01 level. 

TABLE 4 

ANALYSIS OF COVARIANCE 
OF RETENTION SCORES 
FOR ALL CLASSES 



SOURCE 


DF 


*1 
SS ^ 


fts 


F 


P 


Treatment 


1 


383.64 


383.64 


61.90 


<.001 


Regression 


2 


91.33 


45.66 


7.36 


<.on 


Within 


10 


61.97 


6.19 






1 - SS* indicates Sums of Squares on adjusted criteria scores 
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Discussion and Conclusion 

The data of this Investigation Indicated that classes 
receiving instruction with a prior knowledge of the objectives 
did achieve significantly higher on the Achievement Test and 
Retention Test employed, 

A closer examination of the data, as In Table 5, re- 
vealed some Interesting Information, When the means of 
mean scores for experimental and control groups were com- 
pared, a difference favoring the control groups was noted in 
the pre-test measure of IQ and STEP Test, 

The post- test data In the area of achievement and 
retention revealed a difference favoring the experimental 
groups, a difference as was noted earlier, which was signi- 
ficant beyond the ,01 level, 

TABLE 5 

MEANS OF MEAN SCORES 
FOR EXPERIMENTAL 
AND CONTROL GROUPS 
ON THE FOUR MEASURES 



Instrument 


Experimental 


Control 


Difference 

(X-V) 


STEP 


77.62 


78.17 


- .54 


11 


113.49 


115.89 


- 2.40 


ACHIEVEMENT 


68.13 


60.84 


+ 7.29 


RETENTION 


66.48 


56.19 


* 10.29 
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The results of the study support the thesis that provid- 
ing classes with behavioral objectives prior to instruction 
can enhance the performance on achievement tests. Also, the 
data strongly suggest that behavioral objectives and their 
accompanying assessment tasks will cause a resistance to 
forgetting. 

Within the limitations of this study, the use of behavior 
al objectives proved effective in achievement and retention 
with the defined experimental classes. However, there are 
mixed findings in the literature dealing with behavioral 
objectives being used by "students" in independent study and 
programmed instruction. Thus, the results of this study, in 
which "classes" were provided with the behavioral objectives, 
suggest a different direction in the utilization of behavioral 
objectives in instruction. 



APPENDIX A 



BEHAVIORAL OBJECTIVES 

10-1. Order the states of matter. 

10-2. Demonstrate how to calibrate an unsealed thermometer. 

10-3. Construct a Model of a molecule. 

10-4. Predict the behavior & orientation of molecules under 
stated condi ti ons . 

10- 5. Apply the Rule that the particles of solute interact 

with particles of solvent to cause a reduction in 
temperature. 

11- 1. Apply the kinetic theory to explain a phenomenon in 

which a system *s temperature is increased when work is 
done on it. 

11-2. State an operational definition for specific heat. 

11-3. Demonstrate the ability (a procedure) to calculate the 
energy used (lost or gained) to change water from one 
temperature to another. 

11-4. Apply the rule that the mass of an object does not 
change when heated. 

11-5. Describe a model to explain the rate of temperature 
change ¥or a thermometer wrapped in cloth and soaked 
with different solutions. 

11-6. Construct a graph that will illustrate the temperature 
change of two substances with respect to time. 

11-7. Describe the flow of heat energy from regions of high 
temperature to regions of low temperature. 



12-1. Distinguish between the distance that the image of an 
object appears to be "behind" a mirror with the actual 
distance from the object to the mirror. 

12-2. Demonstrate the relationship between the angle at 
which light strikes a mirror and the angle at which 
light is reflected. 

12-3. Construct a diagram which will show the behavior of 
TTgHtpaTsing through different substances. 
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APPENDIX A (Cont’d) 



13-1. Identify the behavior of light based on the wave model. 

13-2, Order the waves from the shortest to the longest 
wavelength. 

13-3. Describe interference patterns in wave phenomena. 



The illustrations and expanded form of the behavioral 
objectives have been omitted from this abstract. 
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